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Abstract 


Computer  vision  research  needs  a  flexible  and  robust  method  to  obtain  accurate  appearance 
of  a  scene.  Such  needs  include  generating  test  data,  using  a  simulator  as  a  part  of  an  algorithm, 
and  generating  model  data  for  object  recognition  and  inspection.  A  sophisticated  and  reasonable 
mechanism  for  generating  scene  appearance  is  a  technique  known  as  ray  tracing.  However,  current 
ray  tracers  are  mainly  develop  for  computer  graphic  research.  They  are  based  on  ad  hoc  re¬ 
flectance  mechanisms;  their  algorithms  emphasize  computational  costs  by  choosing  computational 
expediency  at  the  expense  of  an  appearance  grounded  in  physics. 

We  are  developing  an  appearance  simulator  to  be  able  to  produce  a  scene  according  to  the  laws 
of  physics.  By  combining  the  reflectance  theory  based  on  physics  and  the  technique  of  ray  tracing, 
we  are  able  to  produce  scene  appearances  that  are  adequate  and  realistic  enough  for  computer 
vision.  First,  we  will  briefly  describes  our  reflectance  model  to  be  used  in  our  simulator.  Then,  we 
win  discuss  several  implementation  issues  how  to  embody  the  model  into  real  algorithms.  Finally, 
we  will  generate  several  scene  appearance  to  verify  the  performance  of  our  system  and  rUustrate 
applications  of  this  system.  _ 


1  Introduction 


Computer  vision  research  needs  a  flexible  and  robust  method  to  obtain  accurate  appearances  of 
a  scene.  Such  needs  include; 

•  generating  test  data  -  verification  of  a  newly  developed  algorithm  needs  several  appear¬ 
ance  data  to  which  we  apply  the  algorithm.  Although  it  is  possible  to  obtain  real  data 
under  a  highly  controlled  environment,  such  methods  often  give  us  difficulties  to  choose 
several  photometric,  geometric,  and  noise  parameters. 

•  using  a  simulator  as  a  part  of  an  iterative  recovering  algorithm  -  an  iterative  algorithm 
often  requires  a  component  to  generate  appearances  based  on  a  set  of  parameters  de¬ 
termined  by  the  algorithm  and  then  adjust  the  parameters  from  the  difference  between 
generated  and  obtain  appearances  iteratively. 

•  generating  model  data  -  a  model  based  object  recognition  and  inspection  algorithm  often 
need  model  appearances  from  which  we  can  extract  necessary  features  to  be  used  for 
recognition  and  inspection. 

A  sophisticated  and  reasonable  mechanism  for  generating  scene  appearances  is  a  tech¬ 
nique  known  as  ray  tracing  [1, 4, 10].  Ray  tracing  method  employs  the  principles  of  geometric 
optics.  For  each  pixel  on  the  screen,  a  ray  of  infinitesimal  i\idth  is  traced  from  the  focal  point 
through  the  pixel,  into  object  space.  The  ray  is  tested  against  each  object  in  the  database,  and 
the  object  for  which  this  intersection  is  the  closest  to  the  focal  point  is  used  to  calculate  the 
intensity  of  the  pixel  on  the  screen.  Whenever  it  is  determined  that  a  ray  intersects  a  surface, 
a  secondary  ray  is  first  traced  from  the  intersection  point  toward  each  light  sources.  If  the  ray 
encounters  an  object  between  surface  and  light  source,  the  intersection  point  can  be  considered 
to  be  in  shadow  and  the  intensity  of  the  pixel  diminished  according  to  the  illumination  model. 
A  ray  can  also  be  traced  in  the  direction  of  reflection.  If  the  reflected  ray  intersects  a  surface, 
the  closest  surface  intersected  by  this  ray  is  determined ,  and  a  portion  of  the  illumination  from 
this  second  surface  is  then  used  in  determining  the  total  intensity  of  the  pixel.  This  adds  a 
level  of  recursion  to  the  algorithm  in  that  a  reflected  ray  generates  additional  shadow  rays  and 
possible  other  reflected  rays. 

Current  ray  tracers  are  mainly  develop  for  computer  graphic  research.  They  are  based 
on  ad  hoc  reflectance  mechanisms  such  as  Phong’s  model  [9];  their  algorithms  emphasize 
computational  costs  by  choosing  computational  expedicncey  at  the  expense  of  an  appearance 
grounded  in  physics.  The  end  result  is  that  ray  tracing  does  not  realistically  enough,  for  our 
purposes,  model  appearances  of  scene.  The  goal  of  ray  tracing  is  to  produce  a  scene  which 
looks  natural  and  realistic  to  human  beings.  While  such  a  goal  is  adequate  enough  for  human 
perception  and  recognition,  it  is  not  accurate  enough  to  serve  as  a  simulator  for  computer  vision 
projects.  Vision  research  needs  to  have  the  capability  of  simulation  that  goes  beyond  creating 
scenes  looking  natural  to  human  beings. 
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This  paper  will  develop  an  appearance  simulator  to  be  able  to  produce  a  scene  according 
to  the  laws  of  physics.  By  combining  the  reflectance  theory  based  on  physics  and  the  technique 
of  ray  tracing,  we  are  able  to  produce  scene  appearances  that  are  adequate  and  realistic  enough 
for  computer  vision. 

The  remainder  of  this  paper  consists  of  three  sections.  The  second  section  briefly 
describes  our  reflectance  model  to  be  used  in  oiu*  simulator.  The  third  section  handles  several 
implementation  issues  how  to  embody  the  model  into  real  algorithms.  Finally,  we  will  generate 
several  scene  appearances  to  verify  the  performance  of  our  system. 
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2  Reflection  Model 


Currently,  there  are  two  main  approaches  to  model  reflectance  mechanism:  physical  and 
geometrical  optics.  Physical  optics  is  based  directly  on  electromagnetic  wave  theory  and  uses 
Maxwell’s  equations  to  study  the  propagation  of  light.  In  particular,  the  Beckmann-Spizzichino 
reflectance  model  solves  Maxwell’s  equations  using  the  Helmholz  integral  by  assuming  a  perfect 
conductor  surface  [3].  On  the  other  hand,  geometric  optics,  such  as  the  Torrance-Sparrow  [11], 
analyze  a  path  of  light  ray  to  appr  ximate  the  specular  component  of  reflection  for  rough 
surfaces.  These  the  Beckmann-Spizzichino  physical  optics  model  and  the  Torrance-Sparrow 
geometric  optics  model  have  been  found  to  fit  experimental  data  quite  well  [6,  11]. 

Wehave  proposed  an  unified  reflectance  model  based  on  the  Beckmann-Spizzichino 
and  Torrance-Sparrow  models  that  also  contains  the  Lambertian  mechanism  [8].  This  model 
comprises  three  reflection  components:  the  diffuse  lobe,  the  specular  lobe  and  the  specular 
spike.  We  report  identical  results  for  both  Beckmann-Spizzichino  and  Torrance-Sparrow 
models  under  certain  restrictions,  and  conclude  that,  whenever  the  Torrance-Sparrow  is  simpler 
to  formulate,  the  Beckmann-  Spizzichino  model  is  more  general  and  explains  better  all  the 
reflection  mechanisms  for  different  kind  of  surfaces,  from  smoother  to  rougher.  This  paper  will 
use  this  unified  model  to  get  better  image  of  rough  surface  and  intermediate  surface. 

2.1  Beckmann-Spizzichino  specular  reflection  model 

Beckmann  and  Spizzichino  only  use  the  mean  field  <  E2  >  as  a  stepping  stone  to  derive  the 
mean  scattered  power  <  E2E2*  >  =  <  |  £2  |^  >.  For  an  angle  on  incidence  6i,  the  mean  power 
scattered  in  the  direction  (Or,  <l>r)  by  a  rough  surface,  whose  height  h  is  normally  distributed 
with  mean  value  <  h>  =  0,  standard  deviation  <7*,  and  correlation  distance  T,  is  given  by 


<  E2E2*  >  = 


where 


Eo^A^cos^Bi  _g  f  2 


_t2  rfi  fJTl  . 


E 

m=l 


mint 


(1) 


Po 

D 


^  27r  ^  ( cosSi  +  cosBr )  ^ 

sine  (v,X)  sine  {VyY) 

/  1  +  eosBieosBr  —  sinBiSinBreos4>r 

\  eosBi  ( eosBi  +  eosB^ ) 


(2) 

(3) 

(4) 

(5) 


3 


We  see  from  equation  (2)  that  the  factor  g  in  equation  (1)  depends  on  A.  Raleigh 
criterion  states  that  the  roughness  of  a  surface  can  be  expressed  as  a  function  of  A.  In  this 
sense,  g  represents  the  roughness  of  the  surface  and  the  three  cases  g  <C  1,  g  «  1,  and  g  >  1 
correspond  to  smooth^  surfaces,  moderately  rough  surfaces,  and  rough  surfaces,  respectively.  It 
is  important  to  note  that  the  model  under  consideration  only  attempts  to  describe  the  reflection 
mechanism  that  is  often  referred  to  by  the  vision  research  community  as  "specular  reflection". 
As  seen  from  equation  (1),  the  mean  scattered  power  is  the  sum  of  two  terms.  The  first  term 
e~^ po^  is  the  "specular  spike"  component  of  the  specular  reflection  and  represents  the  only 
the  field  scattered  very  close  to  the  specular  direction.  It  is  seen  from  equation  (3),  that  when 
the  surface  dimensions  are  small,  Po  becomes  a  very  sharp  function  of  di  and  ^^and  is  equal  to 
zero  for  any  direction  of  scattering  except  a  narrow  range  about  the  specular  direction.  Since 
the  mean  slope  of  the  surface  is  constant  and  is  independent  of  the  roughness  of  the  surface, 
a  privileged  scattering  in  the  specular  direction  is  expected.  TTie  second  term  in  equation 
(1)  corresponds  to  the  "specular  lobe"^,  i.e.  the  diffusely  scattered  field  that  results  from  the 
roughness  of  the  surface.  The  specular  lobe  component  is  distributed  around  the  specular 
direction.  For  a  perfectly  smooth  surface,  g  =  0  and  the  specular  lobe  vanishes  while  the 
specular  spike  is  strong.  As  the  roughness  measure  g  increases,  the  spike  component  shrinks 
rapidly,  while  the  lobe  component  increases  in  magnitude.  The  exponential  series  given  by  the 
summation  in  the  lobe  component  may  be  approximated  for  smooth  (g  <  1)  and  very  rough 
(g  >  1)  surfaces.  The  approximations  result  in  simpler  expressions  for  the  scattered  power  for 
these  two  extreme  surface  conditions: 


^2^2  ^smooth  ~ 


Eo^A^COS^Oi  _ji 


Po  +  - - - e  ^  ' 

A 


^  ^2^2  trough  ~ 


A  co^  9i  (  —Vxy^T^ 


exp  . 


V  j 


ig  <  1)  (6) 
(g  >  1)  (7) 


The  above  equations  for  scattered  po'  ‘  >  resent  the  Beckmann-Spizzichino  re¬ 
flectance  model.  Anyway,  we  are  interested  in  the  radiance  of  the  surface,  Lr  which  is 
defined  as  the  energy  of  light  emitted  per  unit  fore-shortened  area  per  unit  solid  angle.  Surface 
radiance  can  be  related  to  image  irradiance  which  we  are  specially  interested  in,  because  we 
want  to  simulate  an  image  taking  from  a  given  scene.  Image  irradiance  is  defined  as  the  incident 
flux  density  in  a  surface  of  the  image  plane. 

Consider  the  image  formation  geometry  shown  in  Figure  1.  The  surface  radiance 

'  We  define  a  smooth  surface  as  one  that  is  either  perfectly  smooth  or  "slightly"  rough. 

^Beckmann  and  Spizzichino  have  referred  to  this  component  as  the  "diffuse"  component.  The  term  "diffuse" 
has  historically  been  used  by  the  vision  community  to  describe  the  reflection  component  that  results  from  other 
mechanisms  such  as  multiple  reflections  and  internal  scattering.  To  avoid  confusion  we  will  refer  to  the  diffuse 
component  of  specular  reflection  as  the  specular  lobe. 
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(8) 


derived  for  this  geometry  [5]  is  given  by  the  following  expression; 

I  <  E2E2‘  > 

'  2  V  e  z^dAiCOS') 

where  e  and  fi  are  the  permittivity  and  permeability  of  the  medium  in  which  the  wave  is 
propagated,  and  dA,  represents  the  image  element  area  (pixel)  which  is  constant  for  a  given 
sensor. 

By  substituting  equation  (1)  in  (8)  we  obtain: 


Lr 


cos^di 
2  cos-) 


e  ^ 


+ 


COsOr 


m=OC 


E 

m=l 


g"”  ^-Vr.'^r/Am 
m\m 


(9) 


Similarly,  from  equations  (6)  and  (7),  the  surface  radiance  for  smooth  and  rough  surfaces 
may  be  written  as 


L 


rsmoolk 


rpEo^co^Gi  /  I zV  dAj  2  . 

V  £  2  Cos-f  ^  V  V  /  ) 


Eq^  CO^Bj  TT  /— Vxy^r^\ 

rrough  \  £  2  A^  cos-r  cosBr  ^  V  J 


(g  <  1)  (10) 
(g  >  1)(11) 


We  can  also  obtain /^(Bi;  Br,  <i>r) ,  the  BRDF  (bidirectional  reflectance  distribution  func¬ 
tion),  of  the  surface  using  its  radiance  Lr  and  irradiance  /,  as  =  Lrlh.  We  see  that  surface 
irradiance  /,  is  defined  as  the  light  energy  incident  per  unit  area  of  the  surface.  The  surface 
irradiance  can  be  obtained  as 

I,  =  SaCosBi  =  J  <  El Ej"  >  cosBi  (12) 

where  the  term  cosBi  accounts  for  the  fact  that  the  same  amount  of  incident  energy  is  received 
by  a  greater  surface  area  when  the  angle  of  incidence  Bi  is  increased  and  Ej  is  the  scalar  value 
of  the  incident  plane  wave. 

The  BRDF  of  rough  surface is  determined  with  equations  (1 1)  and  (12) . 


frsL^GiAh0r,4>r) 


cosBj-rT^D^ 

A^  cosBr  v^  cr/,2  V  4Vz^(T/,^  ) 


(13) 


The  BRDF  of  smooth  surface is  determined  with  equation  ( 1  O')  and  (12).  Houchence 
uses  delta  function  instead  of  sine  function  used  in  equation  (3)  and  obiiuns  BRDF  of  metallic 
surface  in  [6]. 
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frjA.  <?!>,,  ^r,  <i>r) 


exp{—{A7CjCos  Oi)^) 
cos  6idui 


Uidr  -  Oi)  U{6i  +  d9,  -  Or) 


Ui<f>r  -  (<i>i  +  TT))  U(((f>i  +  d(f>i  +  Tt)  -  <f>r) 


where  U{z) 


Jo,  z<0 
I  '  z  >  0 


(14) 


Using  the  same  imaging  geometry  shown  in  Figure  1,  Horn  [5]  has  established  a 
relationship  between  surface  radiance  Lr  and  image  irradiance  7™-  The  image  irradiance  is 
found  to  be  proportional  to  surface  radiance  and  can  be  expressed  as 


(15) 


When  the  image  covers  only  a  narrow  angle  of  the  scene,  we  see  that  7  «  0  and  it  is  reasonable 
to  assume  that  cos'y  =  1  in  the  above  equations. 


2.2  Lambertian  diffuse  reflection  model 

When  light  strikes  on  a  surface  area  dAs  I'let  in  Figure  2,  some  of  the  light  passes  through  the 
surface  and  the  remaining  portion  is  reflected.  Light  penetrating  the  surface  area  hits  internal 
pigments  of  an  object,  is  partly  absorbed,  and  is  randomly  emitted.  We  will  refer  to  this 
reflection  component  as  the  Lambertian  component.  Tae  i  icident  flux  on  the  surface,  is 
given  as  LidwidAsCosOi.  The  surface  irradiance,  /,  is  determined  by  dividing  the  incident  flux 
by  the  siuface  area,  dAs .  Thus, 


Is  =  Lidu>iCos9i. 

Since  Lr ,  the  surface  radiance  given  by  the  Lambertian  component,  is  proportional  to 
the  irradiance  of  the  surface  given  by  a  light  source  [7],  and  Kiamb  is  a  proportional  constant, 
we  can  state  the  following  formula: 


Lrjamb  ~  f^Uimb^idu}iCOS9i 

This  equation  is  known  as  Lambertian’s  cosine  law. 

As  shown  in  [5] ,  BRDF  of  Lambertian  reflection  is  known  as  1  /tt  . 


(f>i,  Or,  (t>r) 


1 

TT 


(16) 


ti7) 
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3  Radiometric  Brightness  Calculation  in  Ray  Tracing 


This  section  describes  the  complete  ray  tracing  algoridim  base  on  the  reflectance  models  de- 
scrbed  in  the  previe  is  section.  To  give  physical  meaning  to  the  ray  tracer,  we  use  the  radiometric 
calculation,  considering  in-coming  and  out-going  light  energy  at  each  surface  patch,  and  get 
image  brightness  based  on  in -coming  energy  of  light.  In  particular,  this  section  will  consider 
how  to  implement  the  reflectance  mechanism,  how  to  calculate  brightness  radiomeirically,  and 
how  to  handle  a  point  light  source  in  the  specular  spike  model. 

3.1  Basic  radiometry  calculation  -  one  surface  reflection 

Radiometrically  radiance  towards  {9r,  6r)  is  denoted  as  following. 


Lrie.,  4>r)  =  JJ(  <l>i,  B, ,  4>r)  +  <f>i,  4>r) 

<f>i,  Br,  4>r)  )  <?>,)  diO,  (18) 

where  A'^m  .  Ks<; ,  Ksl  are  albedo  for  Lambertian,  specular  spike  and  specular  lobe,  respectively. 

As  shown  in  Figure  3  ,  frss  and  f,^  are  distributed  along  the  specular  direction,  frss 
effective  area  is  very  sharp  and /r^.  effective  area  is  wider,  is  same  in  all  directions. 

First  we  show  simplest  example  which  made  of  one  surface  and  one  light  source.  TTien 
we  show  multiple  light  sources  case.  We  also  show  another  example  which  has  two  surfaces 
and  one  light  source.  After  that  we  show  how  we  realize  physical  reflection  models  in  ray 
tracing. 

Consider  the  case  snown  in  Figure  4.  There  is  just  one  light  source  and  one  surface.  A 
ray  tracing  vector  R,  which  starts  from  focal  point  F  and  goes  through  center  of  one  image  pixel 
inters  ;cts  with  “  surface  at  point  P,  .  The  radiance  cf  F,  towards  focal  point  F  ,  direction 
{9r,  (f>r) ,  is  dc  d  as  Lri(Br,  ri  )  and  gives  intensity  of  the  pixel.  In  this  case  the  radiance  ai  i  ^ 
is  caused  o.  j  by  the  light  source  L\  . 

As  we  assume  the  light  is  a  pomt  source. 


Lrl(6r,(i>r)  -  if  ,  <t>i\ ,  ,  <f>r)  +  f  rssi^il ,  <f>r)  +  f  ,  <i>il  4>r)  )  (19) 


where  (B,i ,  0,1 )  is  the  direction  of  L\  measured  from  F, ,  ,  (pn)  is  irradiance  at  F,  given  by 

the  light  source.  fiB,] .  <p,i)  is 


fi^i]  )  )  —  ^ruCHTl  d^i  COS  Bl\ 


where 


(20) 


^ruaim  is  radiance  of  the  light  source,  d^i  is  spatial  angle  of  the  light  source  from  P, ,  r  is  radius 
of  the  light  source,  d  is  distance  between  P,  and  the  light  source. 

If  there  are  N  light  sources,  radiance  is 


(t>l  e,,  cf>r)+frss(0^i,4>l9r.<i>r)+frs,(0l<i>l  Or,  cl>r))Is(e^,  <!>■))  (21) 


*=1 


where  (^,  <f>-)  is  the  direction  of  it-th  light  source  from  P,  ,  is  irradiance  at  P,  from 

fc-th  light  source.  /j(^,  (/)f)  is 


where 


(22) 


radiance  of  /:-th  light  source,  is  spatial  angle  of  ^-th  light  source  from  P, ,  r*  and 
dk  are  radius  and  distance  from  P,  of  /:-th  light  source,  respectively. 


3.2  Basic  radiometry  calculation  -  multiple  surface  reflections 

Consider  the  ray  tracing  geometry  shown  in  Figure  5.  There  is  another  surface  which  can  reflect 
light  effectively  toward  point  P, .  So  radiance  at  P,  towards  focal  point  F  is 


Lr{9r,  <f>r)  =  LM,  <f>r)  +  L,2(^r,  <t>r)  (23) 

where  Lr\  and  Lr2  are  radiance  caused  by  the  light  source  and  interreflection,  respectively. 

To  get  Lr2  ,  we  have  to  calculate  the  (18)  because  next  surface  is  too  big  to  be  considered  as  a 
point.  It  means  we  have  to  care  about  all  the  light  which  incident  to  a  point,  irradiance  at  that 
point,  to  get  radiance  of  the  point,  theoretically.  As  can  be  seen  in  Figure  5,  each  BRDF  has  its 
effective  area,  i.e.  out  of  such  area,  angle,  BRDF  is  negligible.  We  modify  (18)  based  on  this 
concept,  BRDF  effective  area. 

Lr2{9r,(t>r)  =  KsS  j  jj <i>i,  9r ,  s{9i,  4>i)  dw, 

+  j rsS9i^<j)i,9r,<i>,)Is{9i^<i>i)du>i 

+  ATon  J  J^fr^i9i,cf>i,  Or,  (f>r)Is(9i,<f>i)dUi  (24) 

55,  SL,  Lm  denote  effective  area  of  specular  spike,  specular  lobe,  Lambertian,  respectively.  In 
another  words,  we  calculate  each  component  separately  within  their  own  effective  area  using 
ray  tracing  to  find  surface  data  such  as  Kss,  Ksl,  f^un  and  geometric  data  such  as  9,,  4>r,  9i, 
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<i>i.  Also  we  can  distinguish  light  sources  from  surfaces  and  omit  light  sources  from  above 
calculation  of  Lr2  .  Irradiance  /,(^„  (f>d  ,  irradiance  at  Ps  comes  from  (0,,  <?!>,)  direction,  can  be 
calculated  with  radiance  from  P'  ,  the  intersection  point  of  next  surface  and  vector  from  point 
Pf  toward  direction  (0,,  <?i,) .  That  is 

<f>d  =  <f>r)  du  cos  di  (25) 

where  L'(6r',  <f>r)  is  radiance  at  P'  which  is  on  the  next  surface  toward  P, ,  direction  (6/,  (t>r) . 
As  there  is  no  another  surface  which  can  reflect  light  toward  P'  effectively,  we  just  have  to  care 
about  the  light  from  light  source.  So  ^(6/,  4>r)  is 


=  (K'ssf'rA4>\xA\<t>r)  + 

+  4>r’))  ) 


(26) 

(27) 


where  L'l  is  radiance  at  P'  caused  by  the  light  source,  K'un  ,  K'ss  ,  K'si  are  albedo  at  P'  ,  / , 
frss  'f'rsL^^  BRDF  at  P' ,  -1 )  is  the  direction  toward  the  light  source  from  P' .  /'(^-j ,  •, ) 

is  irradiance  at  P'  caused  by  the  light  source. 


Wu<i>n)  =  Lrua^Mcosei, 


(28) 


dw-  is  spatial  angle  of  the  light  source  seen  from  PJ . 


If  there  are  yet  another  surface  which  we  should  consider  as  the  next  surface,  L'(^r^  <f>r) 
becomes 

l;(0;,  <f>')  =  L'M,  4r)  +  <f>')  (29) 

where  L'2  is  r^aance  at  P'  caused  by  interreflection  which  is 

<t>r)  =  fCss  J <i>'n  ,  <f>’)  du^i 

+  K'sl  J l/rM,  <f>'n  Or',  (f>r)  W ,  <P'i)  dUi 

+  fCun  J (30) 
where  <f)'^  ,  irradiance  at  P'  is 

=  L';{e';,<f>';)dujcose\  od 

L'HBr",  (f>")  is  radiance  at  P"  ,  intersection  point  of  the  third  surface  and  vector  starts  from  Pj 
toward  (B',  4>\)  direction. 

This  process  forL'(^/,  <^') ,  from  equation  (29)  to  (31),  is  completely  same  as  that  for Lr(^r,  <f>r). 
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from  equation  (23)  to  (25).  This  iteration  will  be  continued  until  there  is  no  more  next  surface 
which  can  reflect  light  effectively  to  the  point. 

We  have  briefly  explained  how  we  radiometricly  calculate  the  image,  i.e.  radiance  at  the  each 
pixel,  using  BRDF  equations  (17),  (14),  (13)  based  on  radiometric  theories  in  ray  tracing. 
Next  subsections  show  how  we  realize  those  BRDF  equations,  specular  spike,  specular  lobe, 
Lambertian. 


3.3  Calculating  specular  spike  BRDF 


The  effective  area  of  specular  spike  BRDF  is  very  narrow  and  on  the  reflection  direction 
(Or,  +  tt)  .  We  assume  it’s  narrow  enough  to  be  considered  as  a  single  ray.  So  we  only  search 
along  the  reflection  direction,  i.e.  make  the  secondary  ray  tracing  vector  from  P,  toward  this 
direction  to  find  the  intersection  point  P'  on  next  surface.  The  first  portion  of  right  handed  side 
of  equation(24)  can  be  obtained  as 


frssiO„<f>i,er,<f>r)Is(Oi,<l>i)dUi 


f^Ssfrssi^r,  4>r  +  T^,0r,  <j)r)  Is(^r,  4>r  +  Tt) 


(32) 


where  1,(6,,  +  tt)  =  <f>r')  dw  cos  0,  (33) 

w\itTcLr(dr  ,  4>r  )  is  radiance  of  pj  towaid  dircction  (^r  the  direction  from  P' toward 

P,  ,  du  is  the  spatial  angle  which  is  set  as  0.087,  it  is  the  angle  of  5°  cone,  according  to  the 
effective  area  of  specular  spike  BRDF. 

By  substituting  equation  (14)  and  (33)  to  (32),  we  get  following  equation  for  specular  spike 
component  of  radiance  at  P,  toward  the  direction  (6,,  <t>r)  . 


[ [  frss^Oi,  4>i,  Or,  4>r)  4>i)  dUi  =  KsS  — —  ^  ^9,  -  Or)  U(0r  +  dOi  -  0,) 

J  Jss  cosOrdwi 

U(4>r  -  ((<i>r  +  TT)  +  Tt))  U((((f)r  +  Tt)  +  d(j>i  +  Tt)  -  <f>r)L'^(0r\  <i>r')  duj  COS  0, 

=  KsS  eXp(-(4TTjC05  0rf)L',(0r\  4>r)  (34) 

If  the  surface  is  very  smooth,  a  becomes  almost  0  and  equation  (34)  becomes 

Kss  [ [  frs,(0i,  <f>i,  Or,  ct>r)Is(0i,  4>i)  dwi  =  KssL’(0/,  <!>',)  (35) 

J  J  ss 

This  means  the  surface  reflects  same  amount  of  energy  which  comes  from  next  surface  point 
P'  exactly  like  a  miller. 

As  seen  in  Figure  6,  ray  tracing  usually  calculates  the  intensity  at  the  center  of  pixels 
using  only  one  vector  which  goes  though  the  center  of  each  pixel  assuming  that  objects  are 
big  enough  to  cover  entire  single  pixel  or  light  from  the  object  becomes  negligibly  weak  when 
object  is  far  away  and  seen  too  small  to  cover  the  pixel.  But  for  light  sources,  it’s  not  so  as 
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they  are  very  bright  and  small.  Pixels  should  become  very  bright  if  light  source  is  included  in 
sight  of  the  pixels  but  with  ray  tracing  light  source  may  be  out  of  the  narrow  effective  area  of 
specular  spike  BRDF  which  is  laid  aling  the  ray  tracing  vector  if  it  is  not  close  enough  to  the 
center  of  the  pixel  even  though  image  of  a  light  source  is  actually  in  a  pixel.  As  can  be  seen  in 
Figure  7,  we  add  4  more  vectors  to  each  ray  tracing  vector  to  check  if  light  sources  are  included 
in  the  sight  of  each  pixel.  Those,  denoted  with  fine  break  lines  in  Figure  7,  are  generated  from 
focal  point  toward  comer  points  of  each  pixel  and  reflected  same  as  ray  tracing  vector.  If  a  light 
source  is  found  within  those  4  vectors,  irradiance  is  calculated  as  if  the  light  source  is  seen  at 
the  center  of  the  pixel  so  that  the  pixel  becomes  bright.  It  is  reasonable  because  some  point 
on  the  surface  which  is  inside  of  the  sight  of  a  pixel  should  have  reflection  direction  directly 
toward  the  light  source,  like  vector  X  in  Figure  7,  if  the  light  source  is  among  the  4  comer 
vectors. 


3.4  Calculating  specular  lobe  BRDF 


The  effective  area  of  specular  lobe  BRDF  is  wider  than  which  of  specular  spike.  So  we  use 
some  number  of  ray  tracing  vectors  distributed  evenly  in  the  effective  area  instead  of  a  single 
vector  so  that  we  can  realize  the  integration  of  irradiances  from  various  directions.  Then  we 
translate  those  irradiances  to  one  particular  radiance  from  P,  toward  (6^,  <i>r)  direction. 

Now  the  second  portion  of  right  handed  side  of  equation(24)  is 


where  (0",  4>1)  denotes  the  direction  of  /i-th  ray  tracing  vector  from  P,. 
is 

4>1)  =  L'M,  <t>'r)du:cosff:  (37) 

By  substituting  equation  (13)  and  (37)  to  (36),  we  get  following  equation  for  specular  lobe 
component  of  radiance  toward  the  direction  (^r,  <^r)  • 


^SL  2^  (-72 - 2 — 5 — 7 

n  ^  COS9r  V2  (Tk 


-Vj 

4Vi 


L',(e'„4,',)dwcose:U(J^  -  ^))  (38) 

Z  /  2 


To  make  such  distributed  ray  tracing  vectors,  we  make  a  series  of  vectors  C,-  around  Z 
axis  and  swing  them  along  the  reflection  direction. 


C.  = 


[0,0,  If  ;,=0 

[  sin  (m  86)  cos  ^  ,  sin  {m  86)  sin  ^ ,  cos  {m  86)  f  ^  0 


(39) 
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m  =  [^]  +  l 
j  =  i  - I  -  6(m  -  1) 
se  =  5° 

S4>  =  60° 


Vectors  for  actual  search  C/  should  be  distributed  around  the  reflection  direction  R  .  Vector  R 
is 


R  = 


(40) 


where  V^  is  unit  ray  tracing  vector  comes  to  the  point  Ps  from  previous  surface,  N  is  the  unit 
normal  vector  at  that  point. 


By  the  formula  of  Rodorigues,  we  can  obtain  C/ . 


C/  =  cos  ij}  C.  +  sin  0  (w  X  C.)  +  (1  —  cos  rp)  (lj  ■  C,)  uj  (41) 


tp  =  COS-H2.  •  R) 
a;  =  (Z  xR) 

We  also  need  angles  ^  and  <p^  for  the  calculation  of  (38).  Those  are 


=  cos-\C.:  •  N) 

(42) 

(C„'xN)  (V.,  xN)  .  , 

|(C,'xN)|  KV^xN)!^^*^^ 

(43) 

3.5  Calculating  Lambertian  BRDF 

As  our  attention  is  mainly  on  the  specular  reflection,  we  don’t  calculate  diffuse  or  Lambertian 
component  very  precisely.  We  just  calculate  Lambertian  component  caused  by  light  sources 
assuming  that  is  the  dominant  source  of  irradiance. 

So  the  third  portion  of  right  handed  side  of  equation(24)  is 

f  rijt(.^ii  Or,  (pr)  ^  J  J  ^  duJi  —  0  (44) 
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4  Experiments 


We  can  use  our  appearance  simulator  for  several  different  applications.  The  first  application  is 
to  generate  a  physically  based  appearance  of  a  scene  based  on  surface  roughness  parameters. 
The  second  application  is  to  generate  a  necessary  information  for  model  based  vision  such  as 
a  synthesized  depth  map  or  a  map  indicating  interreflection  relation.  The  third  application  is 
to  examine  a  real  range  data  by  generating  a  sequence  of  simulated  images  tor  animation  as  a 
part  of  otir  rapid  prototyping  project. 

4.1  Simulating  Appearances 

Light  source  image  on  rough  surface  We  examine  the  performance  of  our  system  to  handle 
appearances  of  intermediate  rough  surfaces.  We  created  an  image  by  our  appearance  simulator 
using  the  following  parameters:  correlation  distance  of  surface  roughness,  T  is  3.0“®  m  and 
standard  deviation  of  surface  (t  is  1.0“^  m,  and  light  wave  length  A  is  5.55”®  m  .  The  created 
image  as  shown  in  Figure  8  has  two  kinds  of  specular  reflection,  specular  lobe  and  spike 
component,  at  the  same  time. 

Figure  9  shows  an  actual  image  of  a  bowl  whose  surface  is  determined  as  intermediate 
rough.  In  the  dull  specular  area  corresponding  to  the  specular  lobe  reflection,  we  can  observe 
a  small  bright  spot  corresponding  to  the  specular  spike  reflection  of  light  source  image  as 
predicted  by  our  simulator.  Usual  ray  tracers  cannot  simulate  those  two  kinds  of  specular 
reflections. 

Light  source  image  on  smooth  surface  By  changing  the  parameters,  we  can  generate  a 
well-known  spot  specular  reflection  by  using  the  same  appearance  simulator.  Figure  10  shows 
the  created  image  of  smooth  sphere.  There  is  only  bright  spot  which  is  actually  the  reflected 
image  of  light  source.  Parameter  T  is  1 .0”®  m  and  a  is  1 .0“’  m. 


Interreflection  between  rough  surfaces  We  demonstrate  the  ability  of  our  system  to  handle 
appearances  of  interreflection  between  intermediate  rough  surfaces.  Figure  1 1  is  an  image 
created  by  our  simulator.  The  interreflection  reflection  between  intermediately  rough  surface 
can  be  seen.  Parameter  T  is  1.0“®  m  and  a  is  1.0“’  m. 

The  similar  interreflection  can  be  observed  in  Figure  12  of  an  actual  image  of  interme- 
diatly  rough  sphere  on  intermediately  rough  plane. 

4.2  Synthesizing  depth  maps 

We  can  generate  a  depth  map  by  using  our  appearance  simulator  from  a  representation  given 
by  our  geometric  modeler  Vantage  [2]. 
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Figure  13  shows  the  line  drawing  given  by  Vantage.  From  this  representation,  the 
system  generates  a  scene  appearance  as  shown  in  Figure  14  and  a  depth  map  of  the  scene  as 
shown  in  Figure  15. 

Each  plana,  and  curved  surface  has  an  unique  identification  number  (ID  number)  in  our 
simulator.  The  syitem  generates  a  map  of  surface  id  numbers  at  each  pixel;  which  surface  is 
visible  at  each  pixel  position.  Figure  16  shows  such  a  distribution  of  primal  face  ID  number. 
This  map  can  be  regarded  as  a  perfect  segmentation  of  the  scene  into  each  planar  or  curved 
surface. 

The  system  also  generates  a  map  of  surface  numbers  to  which  surface  each  ray  hits  the 
second  time,  after  reflected  by  the  first  surface.  Figure  17  shows  such  a  distribution  of  secondary 
face  ID  number.  By  comparing  these  two  distributions,  we  can  establish  the  interreflection 
relationship  between  svufaces  at  each  pixel. 


4.3  Examining  range  data 

We  are  developing  a  system  to  generate  a  bust  from  a  range  data.  As  shown  in  Figure  18,  the 
system  consists  of  two  parts:  data  acquistion  and  bust  generation.  The  range  data  is  obtained  by 
our  range  finger.  Then,  the  data  is  examined  whether  it  is  appropriate  for  later  bust  generation 
process  by  using  our  system.  The  data  is  converted  into  a  certain  format  and  given  to  the 
stereolithography  system  by  which  we  can  make  a  bust  of  the  human. 

For  this  system,  we  prepare  an  interface  routine  between  the  range  data  acquisition 
system  and  our  ray  tracer  system.  We  obtain  the  data  of  a  human  by  using  the  range  finder. 
Figure  19(a)  shows  a  brightness  image  of  a  human  face,  while  Figure  19(b)  shows  the  isoplot 
image  of  the  depth  distribution. 

From  the  depth  map  of  the  human,  we  can  generate  a  simulated  image  of  the  human. 
Figure  20(a)  shows  the  simulated  plaster  image,  while  Figure  20(b)  shows  the  simulated 
stainless  steel  image.  This  capability  is  used  to  examine  whether  the  obtained  data  is  accurate 
enough  for  making  a  bust  of  the  human  using  the  stereolithography  system. 

Figure  21  shows  th.^  distance  distribution  from  an  arbitrary  focal  point.  Note  that  the 
new  focal  point  is  different  from  the  original  focal  point. 
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5  Conclusion 


We  have  developed  an  appearance  simulator  based  on  a  physically  based  reflectance  model. 
By  using  this  appearance  simulator,  we  can  generate 

•  physically  based  appearances  for  vision  algorithms, 

•  depth  and  interreflection  map  from  a  scene  representation  given  by  a  geometric  modeler 
Vantage,  and 

•  animation  images  used  to  examine  data  consistency  for  making  a  bust  from  a  range  data. 

Our  future  directions  include  to  increase  the  efficiency  of  computation  and  to  accommodate 
more  accurate  camera  characteristics  such  as  defocus  effect  and  lens  distortion. 
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Figure  1:  Image  formation:  light  waves  radiated  by  the  surface  area  dA,  and  gathered  by  the 
lens  are  projected  onto  an  area  dAim  on  the  image  plane.  Adapted  from  [5]. 
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Figure  3:  Polar  plots  of  the  three  reflection  components  as  function  of  the  source  angle  for  a 
fixed  viewing  direction. 
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Figure  4:  Ray  tracing  geometry  (1  light,  no  another  surface) 
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Figure?:  Rxovery  of  light 


Figure  8:  Ray  tracing  image:  intermediate  roughness  surface 
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Figure  9:  Actual  image:  intermediate  roughness  surface 


Figure  10:  Ray  tracing  image:  smooth  surface 


Figure  11:  Ray  tracing  image:  intermediately  rough  ball  and  plane 
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Figure  12:  Intermediately  rough  ball  and  plane 


Fig\ne  13;  Line  drawing  of  a  scene  generated  by  Vantage 
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Figure  14:  Appearance  generated  by  the  simulator 


Figure  15:  Depth  map  generated  by  the  simulator 


Figure  16:  Distribution  of  primal  face  ID  number 


Figure  17:  Distribution  of  secondary  face  ID  number 
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triangularization 


stereolithography 


acquisition  of  3D  data 
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Figure  18:  Bust  generation  system 
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Figure  19:  Input  Images;  (a)  brightness  image;  (b)  isoplot  image  of  a  depth  map 


Figure  20:  Simulated  images;  (a)  plaster  image;  (b)  stainless  steel  image 
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Figure  21:  Distance  distribution 


